ON THE REDUCTION OF THE SIEGEL MODULI SPACE OF 
ABELIAN VARIETIES OF DIMENSION 3 WITH IWAHORI 
LEVEL STRUCTURE 



PHILIPP HARTWIG 

Abstract. We study the moduli space of abelian threefolds with Iwahori 
level structure in positive characteristic. We explicitly determine the fibers of 
the canonical projection to the moduli space of principally polarized abelian 
varieties and draw conclusions about the relationship between the Ekedahl- 
Oort, the Kottwitz-Rapoport and the Newton stratification on these spaces. 



1. Introduction 

Fix a prime p, an integer g > 1 and an algebraic closure F of Fp. Denote by Ag 
the moduli space of principally polarized abelian varieties of dimension g over F 
and by Ai the moduli space of abelian varieties of dimension g over F with Iwahori 
level structure (see Section [5] for details). 

In this paper we determine an explicit description of the fibers of the canonical 
projection n : Ai ^ Ag in the case g — 3 and use this description to study the 
relationship between the natural stratifications on Ai and Ag. 

On Ag we have the p-rank stratification which has the property that two abelian 
varieties lie in the same stratum if and only if their p-ranks coincide. We have 
the Ekedahl-Oort stratification, originally defined in [Tl], which is given by the 
isomorphism type of the kernel of multiplication by p on the abelian variety. There 
is an explicit bijection from the set of EG strata to the set of final sequences of 
length g, that is, to the set of maps ip : {1. . . . , 2g} N with ?/)(0) = 0, ip{2g) — g, 
such that 

ipii) < + 1) < + 1 

and 

■0(0 < ip{i + 1) -0(25 - i) = -0(2^ - i - 1) 
for < z < 2g. If is a final sequence, we denote the corresponding EG stratum 
by EO^. 

Trivially the EG stratification is a refinement of the p-rank stratification. 

Furthermore we have the Newton stratification, given by the isogeny type of the 
Barsotti-Tatc group of the abelian variety. We are primarily concerned with one 
special Newton stratum, namely the supersingular locus Sg. In general neither of 
the Newton or the EG stratification is a refinement of the other. In fact the super- 
singular locus is not a union of EG strata for g > 3. In [11 Harashita determines 
those EG strata that are entirely contained in the supersingular locus. 

For (? = 3 there are four EG strata of p-rank 0, totally ordered by their dimen- 
sions. By Harashita's result, the 0- and the 1-dimensional stratum are contained 
in the supersingular locus. Using a normal form for the Dieudonne module of the 
Barsotti-Tate group of a supersingular abelian variety, due to Harashita, we prove 
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that the 2-dimensional EO stratum is contained in the complement of ^3 . It then 
follows for dimension reasons that the 3-dimensional EO stratum intersects the 
supersingular locus in an open dense subset of 53. 

On Ai we have the Kottwitz-Rapoport stratification, given by the relative posi- 
tion of the chain of de Rham cohomology groups and the chain of Hodge filtrations 
associated with an element of Aj. There is an explicit bijection from the set of 
KR strata to the set of admissible elements Adm(/L(), where the latter is a subset 
of the extended affine Weyl group of the group of symplectic simihtudes GSpjg. 
There is a unique element r of length such that Adm(/i) C WaT, where Wa is the 
affine Weyl group of G, a Coxeter group generated by simple reflection sq, . . . , Sg 
(described explicitly in Section [^^ . 

We denote by Si the preimage of Sg under tt, which we also call the supersingular 
locus. In [7] and [8] Gortz and Yu study the dimension of Sj and they determine 
those KR strata that are entirely contained in the supersingular locus. But again 
it is not true in general that Sj is a union of KR strata and it is natural to ask 
which other KR strata have a nonempty intersection with the supersingular locus 
and what the dimension of this intersection is. Another question concerning the 
KR stratification deals with its relationship to the EO stratification. It is known 
that the image of a KR stratum under tt is always a union of EO strata but it is 
not known which EO strata occur in the image of a given arbitrary KR stratum. 
This question has been studied by Ekedahl and van der Geer in [3] (cf. [HI Section 
9]) and also by Gortz and Hoeve in [B] . 

To answer these questions for g = 3 we need to investigate the fibers of tt. 
Classical Dieudonne theory provides us with an injective map from a fiber of tt 
into a suitable flag variety over F and it can be shown that this map is actually a 
universally injective, finite morphism of algebraic varieties over F. In particular it 
induces a universal homeomorphism onto its image and in order to study topological 
properties of the fibers it is therefore sufficient to study their images under these 
respective maps. Up to isomorphism these images only depend on the EO stratum 
of the basepoint and hence there are only finitely many cases that have to be 
considered. If -0 is a final sequence we denote this image of the fiber over a point of 
E0^{¥) by Flag^j;'-^'^ = Flag^f^^. While the conditions that determine Flag;j;'-^'^ 
as a closed subvariety of a full flag variety over F are easy to describe, the geometry 
of the resulting variety is rather complicated. 

To give the reader an impression of what has to be expected let us sketch the 

F V 

geometry of the variety Flag^^ ' , where EO^g is the 0-dimensional EO stratum, 
see Section [9?T] 

Theorem 1.1. Let g = 3 and let A G .43(F) be a superspecial abelian variety. 
Then there is a universal homeomorphism from the fiber Tr^^{A) onto Flag^^^'^. 
The variety Flag^^^'^ is decomposed into irreducible components 

where I can be chosen as {{x : y : z) G P^(Fp2) | x^z + y^~^^ + xz^ = 0} and such 
that 

• Y is isomorphic to the variety of full flags in ¥^ , 
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Z can be considered as a V^-bundle over a variety Zq, where Zq is itself a 
¥y bundle over the irreducible curve V+iXfXs + X^^^ + XiX!^) C (for 
homogenous coordinates Xi , X2 and X^ on P| ), 
• each Tq is isomorphic to the blowing-up o/Pp in a closed point 



Sticking to the notation of the Theorem, we see that diml" = dimZ = 3 and 
dimT^ = 2. Furthermore the are pairwise disjoint. The intersection Y f] Z \s 
isomorphic to the variety Zq. Z intersects each Tq in its exceptional curve, while 
y nT(;- is a different subvariety of Tq isomorphic to Pj.. Finally the triple intersection 
y n Z n only consists of one point. 

Concerning the fiber over abelian varieties of positive p-rank we prove the fol- 
lowing general result (modelled on the "shuffle construction" explained in [TBI 5-2]) 
that provides a method for reducing the case of positive p-rank to the case of p-rank 
in lower dimensions, see Section [TT] 



Proposition 1.2. Let g > 1, k > and let A E Ag{¥) be of p-rank k. Let ip be 
the final sequence with A G -BO^ . 

(1) Let A be ordinary. Then the fiber over A is discrete and 

# (n-^A)) = ON, 2^#Flag^(Fp) = 2^U!^^_ll, 

Here we denote by Flagg(Fp) the set of flags {y^j)j^Q in (Fp)^ with dim = 
j for all < j < g . 

(2) Let 1 < k < g — 1. Then Flag^'^'^ is isomorphic to ^'^^ ON^ disjoint 
copies o/Flag~'^'^ where is the final sequence of length g ~ k deter- 



mined by = 'ilj{k -\- i) — k for < i < g — k. 



This result will allow us determine the number of connected components of the 
fibers of tt: 



Proposition 1.3. Let g > 1 and k > 0. If A E Ag(¥) is of p-rank k, the fiber 
TT^^{A) consists of 
if and only if k = 0. 



TT {A) consists of I ' I ONk connected components. In particular it is connected 



From the calculations of the varieties Flag^'^'^ for g = 3 it is rather easy to 
determine which KR strata intersect the fiber of tt over a given element of yl3(F) 
and what the dimension of this intersection is. From this we can determine the EO 
strata which occur in the image of a given KR stratum: 



Theorem 1.4 (Section I17p . For an element x E Adm(/i) of p-rank denote by 
ES(x) the set of final sequences such that tt{Ai_x) = 1Jj/)GES(2;) -^'^'Z' ■ Then the 
following table contains a complete list of the sets ES(a;) in the case g — 3. 
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X 


ES(a:) 














sioT, S23T, S20T, S3ir, soi'T, S32T 


V'2 


S310''', S320''' 


-00 V'2 


S3120''' 


-00 01 V'2 


Sl20'r, S312T, S2OIT, S231T 


01 02 


SOlO''', S323''', S3OI''', S230''' 


0'3 


S2301''' 


-00 0'1 ^03 


S3OIO''', S323OT 


V'2 03 



Here ■0^ denotes the final sequence corresponding to the i- dimensional EO stratum 
of p-rank 0, < z < 3. 

The upper block of the table contains the supersingular elements. 
With this table we can show that the inclusion 



(1.1) 



2:eAdm(/i)<°' 



\EO^<ZSg 



J 



which is valid for every 17 > 1, is a proper inclusion for 5 = 3, negatively answering 
a question posed in a preliminary version of U • 

Finally we show that for g = 3 we have dim(^/ n 5/) = diva Ai^x — 1 for every 
KR stratum Ai^x with C Ai^x <^ Sj C. Ai^x- 

Acknowledgments. I sincerely want to thank Ulrich Gortz for introducing me 
to this subject and for his permanent interest in my work. The help he provided 
during the writing of this paper has been invaluable. I also want to thank Michael 
Rapoport and Chia-Fu Yu for helpful comments. 

2. Notation 

2.1. Basic notation and moduli spaces. We fix a prime p, an integer g > I, 
an integer N > 3 coprime to p, an algebraic closure F of ¥p and a primitive iV-th 
root of unity (^n in F. Let cr : F ^ F denote the Frobenius morphism. We consider 
the moduli space Ag = Ag^N of principally polarized abelian varieties of dimension 
g over F with a symplectic level- iV-structure with respect to Cn- It is a quasi- 
projective scheme over F, irreducible of dimension g{g+ l)/2. We will usually omit 
the principal polarization and the level structure from our notation. We denote 
by Sg the supersingular locus inside Ag. It is a closed subset, equi-dimensional of 
dimension [|] by [T^. 

On the other hand, we consider the moduli space Ai of tuples 



Ag,XoAg,V), 



where 



each Ai is a g-dimensional abelian variety over F, 
a is an isogeny of degree p, 

Ao and Xg are principal polarizations on Aq and Ag , respectively, such that 
{asyXg =pXq, 
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• 77 is a symplectic level- A^-structure on Aq with respect to ^n- 

Ai has pure dimension g{g + l)/2. We will often omit 77 and even Aq, Xg from the 
notation. 

We denote by tt : Aj Ag the morphism sending a point 



to the point (^0^^0,77). It is proper and surjective. 

Inside Ai we have the supersingular locus Sj, given by n~^{Sg) as a closed subset. 
It is shown in that for g even we have dimSj = g'^/2 and that {g^ — g)/2 < 
dim 5/ < {g^ — l)/2 if g is odd. However the supersingular locus Si is not equi- 
dimensional as soon as g > 2. 

2.2. The p-rank stratification. Let X be a topological space. We call a set- 
theoretical decomposition X ~ Yliei oi X a stratification on X if for all i S / 
the set Xi is nonempty, locally closed and satisfies Xi = Uj^j-Xj for some subset 

J^ C /. 

Let A be an abelian variety of dimension g over F. For n G N we denote by A[n] 
the kernel of multiplication by n on A. It is a finite group scheme of rank over 
F. There is an integer < i < g with A[p] (F) ~ (Z/pZ)', called the p-rank of A. We 
denote by aIJ"^ the subset of Ag where the p-rank of the underlying abelian variety 
is i. Then Ag — UigN-^g'' is a stratification on Ag with ylg' Uj<iAg'''' . Similarly 
we write A^j'' — Tr^^{A'"J^), but these sets do not give rise to a stratification on Aj. 

2.3. The a-number. Let ap be the F-group scheme representing the functor S 

{s e Os{S) \ sP = 0} on the category of F-schemes. For an abelian variety A over 
F we write a{A) = dim^ Honi(ap, A). This integer is called the a-number of A. 

2.4. Group theoretic notation. We denote by G = GSp2g the group of sym- 
plectic similitudes. We consider it as a subgroup of GL2g with respect to the 
embedding induced by the alternating form given on the standard basis vectors 
ei...,e2g by (6^,6^) >-> 0, {e2g+i^i, e2g+i-j) 1-^ and {e^,e2g+i-j) 1-^ Sij for 
1 ^ hj 5: 5- We use the Borel subgroup of upper triangular matrices and the 
maximal torus T of diagonal matrices. We denote by W the finite Weyl group of 
G which we consider as a subgroup of the finite Weyl group of GL2g . If we identify 
the latter with S2g in the usual way, an element w of S2g lies in W if and only if 
w{i) + w{2g + l-i) = 2^-1-1 for alll < i < 2g. Similarly we identify X^{T) with the 
group {(ai, . . . , a2g) £ Z^^' | ai + a2g = 02 + a2g-i = ■ ■ ■ = ag + ag+i}. For an ele- 
ment X = {xi, . . . , X2g) of X*(T) we also write x{i) instead of Xi. W is generated by 
the elements si, . . . , Sg given by Sg = {g,g + 1) and Si = (i,i + 1)(2(/ + 1 — i,2g — i) 
ior 1 < i < g — 1. Inside W we have the subset Wfinni,g of elements w with 
w{l) < w{2) < ■ ■ ■ < w{g). 

We denote hy W = W « X^,{T) the extended afRne Weyl group of G. For an 
element A € X^{T) we denote by t^ the corresponding element of W. We denote 
by So and r the elements of W given by So = (l,2.9)t(i^0-'° and 



{Ao ^ A, 



a 



a 



Ag, Ao, Ag,?/) 




9 .9 + 1 
2g 1 
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The afHne Weyl group Wa of G is the subgroup of W generated hy sq, . . . , Sg. It is 
an infinite Coxeter group. Our choice of generators sq, ■ ■ ■ ,Sg gives rise to a length 
function £ and the Bruhat order < on Wa- We write Sii...i„ instead of s^^ • • • Si„. 

2.5. Convention. Let K be an algebraically closed field. A variety (over K) is a 
reduced scheme of finite type over Spec K. A subvariety of a variety is a reduced 
subscheme. If we identify a variety X with its set X{K) of ii'- valued points we 
refer to the latter object as a classical variety. 

3. DiEUDONNE MODULES 

This section introduces our notation for the Dieudonne modules associated with 
the p-torsion of a principally polarized abelian variety. The principal polarization 
induces an isomorphism from the Dieudonne module onto its dual and hence an 
isomorphism between co- and contravariant Dieudonne theory. For most of our 
statements it will therefore not matter which theory we use. For the few statements 
where it is of importance, we will use the contravariant theory. We refer to [2J and 
[13] for proofs of the statements below. 

Given a ring i?, an endomorphism a : R ^ R and an i?-module A/, an additive 
map (j) : M —^ M is called a-linear if (j){r ■ m) — a{r) ■ (j)(m) for all r e i?, m G M. 

Let g>l. 

3.1. The Dieudonne module of ^[p]. Let A e yig(F) and denote by D = D(A[p]) 
the Dieudonne module of It is a 251-dimensional vector space over F, ec^uipped 
with hnear maps F : B^p^ D and V : B ^ D(p\ called Frobenius and Ver- 
schiebung respectively, where B>^p^ denotes the base change D (8)F_cr F- As a is an 
isomorphism we can identify D^^^ with D and we will henceforth consider _F as a 
cr-linear and F as a (T~^-linear map D ^ D. The principal polarization A 
induces a non-degenerate, alternating pairing (•,•) — {■-,■) a '^^ ^ ^^"^ 
pairing have the following properties: 

Proposition 3.1. (1) iiaV = kerF and imF = kerV^. 

(2) {Fx, y) = {x, Vyf for all x, y G D. 

For future reference we include the following 

Corollary 3.2. (1) For any subspace W cD we have V{W^) = F-^{W)-^. 
(2) (imy)-L = imy. 

Proof. (1) Using Proposition 13. ll( 2|l we have 

X € F-\W) ^yy eW^ {Fx,y) =0^yy eW^ {x,Vy) = ^ x e V{W^)^ 

and the statement follows. 
(2) By ([T]) and Proposition 13 . 1 p ]l we have 

(imy)-L = y(D)-L = y(0-L)-L = F'^{0) = keri^ = imy. 

□ 

3.2. The Dieudonne module of Let A G ^g(F). We denote by A[p°°] = 
UnA[p"] the Barsotti-Tatc group of A. It has height 217. Associated to is the 
Dieudonne module Doo = D(y4[p°°]). It is a free module of rank 2g over the Witt 
ring W{¥) of F, equipped with hnear maps F^o : ~> Doo and Ko : Doo D^\ 
called Frobenius and Verschicbung respectively, where D^'' denotes the base change 
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Doo (!^w{¥),crw Here we denote by aw the Frobenius morphism on M^(F). 

As <7w is an isomorphism we can identify D^-* with Dqo and we will henceforth 
consider Foe as a cvF-linear and Voo as a cr^^-linear map Dqo — Doo- The principal 
polarization A — > induces a perfect, alternating pairing i-,-)^ = (t)ooA 
Doo- -Foo, ^oo and this pairing have the following properties: 

Proposition 3.3. • i^ooV^oo = Ko^oo = p ■ id. 

• {Foc^x, y) = {x, VocvT^^' for all x,y eD. 

The reduction of (Doo, Fqo, Kx., (•, •)oo) modulo p is isomorphic to (D, F, V, (•, •)). 

3.3. Supersingular Dieudonne modules. We recall a result by Harashita, see 
[TTl Section 3]. Let A e Ag{¥) be supersingular. Then there exists a basis 
{Xi,...,Xg,Yi,...,Yg) of Doo over T^(F) such that 

• i^i^ yj)oo - {X^^^,)oo = 0, >S>oo = for 1 < i < .g. 

• Let w = ((5,,g+i_j),j e M9X9(W^(F)). There is an e e W^(Fp2)^ with e = 
— e'^"' and a strictly lower triangular matrix T E M^^^ {W{¥)) satisfying 
Tw = [TwY , such that -Foo and Voo admit the following descriptions with 
respect to this basis: 

F ^ ~pe-^w\ y ^( ^ -pe-y\ 

°° \ew / °° \ew wT'^w w j 

Reducing modulo p, we get a basis (Xi, . . . , Xg, Yi, . . . ,Y g) of D(A[p]) over F such 
that 

.(X„Fj)=%, (X„X,) = 0, (F„Fj)=0 forl<z,j<.g. 

• Let w = {5i^g+i-j)i,j e M9><9(F). There is an e e F^a with e = -e'^ and a 
strictly lower triangular matrix T E AI^^^{¥) satisfying Tw = {TwY, such 
that F and V admit the following descriptions with respect to this basis: 

yew Oj ' \£w wT" wJ 

We have a{A) rank(T). 

4. The EO stratification 

This section contains the results about the EO stratification on Ag that we are 
going to use. 

4.1. Final sequences. We recall a notion defined in [14]. Let g E N. A final 
sequence (of length g) is a map %p : {1. . . . , 2g} N with ^{0) = 0, ip{2g) — g, 
such that 

^{i) < + 1) < -0(«) + 1 

and 

i/'(i) < V'(« + 1) ^ V'(2.9 -i) = iPC^g - « - 1) 
for < i < 2g. Let ES = ESg be the set of final sequences of length g. We will 
identify ES with tVfinai = Wfinai,g via the bijection Wfinai ^ ES given by w "010 
with 

ipwii) = i - #{a e {1, . . . , 5} I w{a) < i} 
and •ipw{2g ~ i) — ^Jw{i) + 9 ^ i for < i < g. Instead of ip we will also write 
(i/'(l), '0(2), • ■ • , ipig)) to denote a final sequence. 
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4.2. The canonical filtration. Let A g Ag{¥). Consider the set e of all finite 
words in the symbols F and _L. In [TH Section 5], Oort shows that {W^(D) | e e} 
is a filtration by linear subspaces 

= W^O C • • • C VKj C • • • C VK^ C • • • C W^2r = D 

such that 

(1) For every < j < 2r we have _L (Wj) = W2r-j- 

(2) There is a surjective function v : {0, . . . , 2r} — > {0, . . . , r} such that F{Wj) = 
Wi,(j) for every < j < 2r. 

It is called the canonical filtration of A. Let p : {0, . . . , 2r} ^ N be given by 
rank(Wi) — p{i). We associate with A a final sequence ip = ip(A) using these 
data. Suppose {i/'lO), V'(l), ■ • ■ j "0(^(0)} has been defined for some < i. Define 
{V(0), . . . , V(p(» + 1))} by i,{p{i)) = + = • • • = Hpi^ + ^)) ifv{i + l) = vii) 

and by ip{p{i)) < i^{p{i) + 1) < • • • < + 1)) if v{i + f ) > v{i). We denote by 

WA the element of tyfinai corresponding to ip{A). 
The main result in this context is 

Theorem 4.1. [IT, Section 9] Let ^1,^2 G Ag{V). Then V^^i) = -0(^2) «/ a?irf 
only if Ai[p\ ~ A2[p] as finite group schemes over F. 

We will need the following 

Lemma 4.2. For A G Ag{¥) we have dimim(l/^) = 0'(.g). 

Proof. It follows from [Ml Remark, p. 18] that diniim(i^^) = i'ig)- Using Propo- 
sition [3TlJ[T|) and Corollarv l3.2l we see that 

imF^ = V{miV) ^ ViiiwiV)^) = (i^"^(im V"))-^ = (^"^(keri^))^ = (kerF^)^ 

Hence dimim(F^) = 2g — {2g — dimim(F^)) = dimim(i^^). □ 

4.3. The EO stratification. On Ag we have the Ekedahl-Oort stratification (a 
stratification in the sense of Section 12. 2p 

A = II EO^^ 

given by j4 G i?0^(F) if and only ii w = wa- Using the bijection from Section [47T] 
we will also index the strata by elements of ES. 
We list some properties of the EO stratification. 

Proposition 4.3. Let w G Wgnai- 

(1) The stratum EOw is contained in Sg if and only if u)(i) = i for 1 < i < 

9-m- 

(2) If EOw is not contained in Sg, then EO^ is irreducible. 

(3) The p-rank on EOw is given by 

{!,..., g} I w{i)=g + i}. 

(4) The stratum EO^ is equi- dimensional of dimension 

a 

dim£^Ou, = £{w) — ipwji)- 
1=1 

Let ip.-ip e ES. 
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(5) The a-numher on EO^ is given by g — tpig)- 

(6) Iftpii) < 4>{i) forl<i<g then EO^ C WJ^. 

Proof. (5) can be found in [TTJ p. 5], (6) is shown in ^Mj 14.3]. See ^ Proposition 
2.3 - 2.5] for the other points. □ 

In view of property ([3]) we denote by Wg^/g^j the set of final elements of p-rank i 
and by ES^*-' the set of final sequences of p-rank i, < i < g. 

4.4. EO strata for g = 2. The following table contains all final sequences ip G ES 
and the corresponding elements of Wfinai for g — 2. We also make explicit some of 
the information on EO^ contained in Proposition [4?3l 



ES 




dim 


p-rank 


a-number 




(0,0) 


id 








2 


V 


(0,1) 




1 2 3 4\ 
1 3 2 4/ 




1 





1 


V 


(1,1) 


Sl2 


^1 2 3 4A 

v2 4 1 3y 




2 


1 


1 




(1,2) 


S212 = 


/I 2 3 4' 
[^3 4 12^ 


) 


3 


2 








In particular we see that for g — 2 the relationship between the EO stratification 
and the supersingular locus is very easy to describe: We have ^2 = EOid U EOs^ 
and 52 n EOs,, =^2 EOs^,, = 0. 



4.5. EO strata for g = 3. The following table contains all final sequences -0 G ES 
and the corresponding elements of VFfinai for = 3. We also make explicit some of 
the information on EO^f, contained in Proposition [4?3l 



ES 


Wfinai 


dim 


p-rank 


a-number 




(0,0,0) 


id 








3 


V 


(0,0,1) 


/I 2 3 4 5 6\ 
^ ^1 2 4 3 5 e) 


1 





2 


V 


(0,1,1) 


/I 2 3 4 5 6\ 

^ VI 3 5 2 4 ey 


2 





2 




(0,1,2) 


/I 2 3 4 5 6\ 
^^^^ ^ VI 45236/ 


3 





1 




(1,1,1) 


/I 2 3 4 5 6\ 
S123 - 1^2 3 6 1 4 5/ 


3 


1 


2 




(1,1,2) 


/I 2 3 4 5 6\ 
S3123 - 1^2 4 6 1 3 5/ 


4 


1 


1 




(1,2,2) 


/I 2 3 4 5 6\ 
523123 -(^3 5 6 1 2 4j 


5 


2 


1 




(1,2,3) 


/I 2 3 4 5 6\ 
S323123 -(^4 5 6 1 2 3j 


6 


3 








4.6. The isomorphisms "^/a- For n e N we endow F^" with the non-degenerate 
alternating pairing (•, •) = (•, defined on the standard basis {ei)f2i by (^i, Cj) = 
= (e„+i,e„+j) and (ei,e„+j) — Si,j for i,j e {1, . . . ,n} (note that this pairing is 
different from the one used in Section 12. 4p . 
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Let A E Ag{¥) and w ~ wa- In [SI Section 9], Oort constructs an isomorphism 
■■ F^f D{A) such that the endomorphisms = and K, = ^>\V of 

F^f map standard basis vectors to standard basis vectors up to sign and such that 



)^ = (•, ■)jjp£. As the notation indicates these puUbacks only depend on w. 



^* 

They are given as foUows. 

Let w e Wfinai,g with corresponding final sequence ip S ES. Denote by 1 < 
TOi < m2 < • ■ ■ < Trig < 2g the set of all m e {1, . . . , 2g} with iplm — 1) < ■0(to). 
Denote by 1 < ng < n^-i < ■ ■ ■ < ni < 2g the complementary set. In particular 
rrii + Ui — 2g + 1 for all 1 < i < Now for 1 < i,i < <? we have Fyj{e2g+i-i) = 
and 



Furthermore 



and 



Fw ipi) 



^g+nii 





if Z = TOj 

if i = rij 

\i Ui < g 
\i TTii < g 

ii rrii < g 
ii Ui < g 



As we are going to make extensive use of these puUbacks in the cases g 
g — 3 we make this description explicit in the next subsections. 



2 and 



4.7. g ~ 2. We describe the puUbacks F^ and Vw depending on w G W^finii for 
g — 2 with respect to the standard basis (ei, . . . , 64). 



nal 



id 



S2 



/O 0\ 



10 

Vi 0/ 



/O 1 0\ 





Vi 0/ 







0\ 

0-100 

V-1 0/ 



/O 0\ 


0-100 

Vo 1 o/ 



4.8. g = 3. We describe the puUbacks F^ and I4, depending on w G WKgnii 
5 = 3 with respect to the standard basis (ei, . . . , eg). 



for 



Wfinal 


F 


V 






(0 














o\ 










































































id 


























































1 























-1 






















1 























-1 






















V 


































V 








fo 





1 








o\ 






/o 














o\ 


















































S3 












































































-1 




















1 





















-1 




















V 














V 






Vo 








1 
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/n 
( 


1 
1 











n\ 

1 








A 






(J 


o\ 























A 











A 


A 

(J 


A 


A 







S23 




n 
u 


n 
U 


n 
U 


n 
u 


n 
u 


n 
U 











n 
u 


n 
u 


n 
U 


n 
U 







































-1 























1 


























1 














V 














V 






Vo 


-1 



















fo 


1 











o\ 






/o 














o\ 














1 



































■S323 












































































-1 
















































1 














V 














0^ 

















1 


0) 





5. The EO stratification and Sg for 5 = 3 

We determine the relationship between the EO stratification and the supersin- 
gular locus Sg for g = 3. As Sg C A'-^^ we only have to look at the EO strata of 
p-rank 0. 

Theorem 5.1. Let g — 3. 

(1) EOid,EOs,(lS3. 

(2) EOs^.nSs^d}. 

(3) EO a dense open subset of S^ of pure dimension 2. 

Proof. (1) See Proposition [43] or Section [4751 

(2) By Section [^751 the a-number on EOs23 equal to 2. Let A E 53(F) be a 
supersingular abelian variety with a{A) = 2 and choose a basis {Xi, X2, X3, 
Yi,Y2,Y3) of D(A[p]), a matrix T and an element e with the properties of 
Section [3731 We have rank(T) = g — a{A) = 1 and the symmetry condition 

/O 0\ 

for T then imphes that there is a t G F"" with T = . We deduce 

\t 0/ 

that the canonical filtration of A is given by 

c (Fi) c (Fi,F2) c {tX; + eY3,Yi,Y2) c (Fi,F2,F3,X3) 

C (Fi,F2,F3,X2,X3) CD(A) 

with r = g = 3, p{i) — i for < i < 6 and v{0) = = v{2) — 0, 11(3) = 
w(4) = 1, v{5) — 2, v{6) — 3. Hence A lies in EOs3 ^^'^ ou'^ claim is shown. 

(3) Set U = EOss23(^S3. By Proposition [U we know that = A'^°\ As 
£'Os323 is locally closed, this implies that EOs323 is open in a'"^'' , hence U 
is open in 53. Now 53 is equi-dimensional of dimension 2, hence the same 
is true for every nonempty open subset of ^3 . But S3 — U = EOid U EOs^ = 
EOs3 dimension 1 and this implies that U intersects every irreducible 
component of iSs, hence it is even dense in 53. 

□ 

Remark 5.2. According to [TlJ Remark 1, p. 8] it is true for any .g > 3 that 
^0(0,1, ....g-i) 1^ is open and dense in Sg. 



12 



PHILIPP HARTWIG 



6. Flag varieties and corresponding notation 

We want to study the fibers of n : Ai ^ Ag. Instead of investigating them 
directly we will look at their image under an injective, finite morphism with values in 
a suitable flag variety. This is sufficient if we are only interested in their topological 
properties. Before introducing this morphism in the next Section we have to fix 
some notation concerning flag varieties. 

6.1. Flag varieties. Let n E N. For < i < n we denote by Flagj „ the variety of 
partial flags {W/y^^Q in F" satisfying dimWj — j for all < j < z. We write 
Flag„ = Flag„ „. We denote by Flag^„ the variety of full symplectic flags in 
F^" with respect to the pairing (•, •) — (•, defined in Section l46l If we have 
an element (Wi)"=o '^^ Flag„ 2„(IF) with Wn totally isotropic we will occasionally 
consider it as an element of Flag^„(F) by implicitly extending it to the flag (Wi)i"o 
with W2„^i = for < i < n. 

Let g > 1 and w E Wfinai- We denote by Flag^'^ — Flag^'J^ the closed subvariety 
of Flag2g whose F- valued points are given by those flags (M^i)^£o satisfying 

(*) F^{W,),V^iW,)(lW, 

for all < i < 2g. We write Flag^'^'^ = Flag^f^^ = Flag^'J^nFlagi^a^. It follows 
from Proposition Ol2]) that an element (Wi)?=o ^ Flag^g(F) hes in Flagi'^''^(F) 
if and only if it satisfies condition (*) for < i < g. 

6.2. Standard charts. For a field K and k,l E N we denote by FU'^'^^K) the 
set of A; X Z-matrices with entries in K of full rank. Let n, i be as above. There is 
a canonical surjection $ : FM"^*(F) Flag, „(F) sending a matrix B to the flag 
{Wj)'j^Q with Wj spanned by the first j columns of B. 

Given pairwise distinct ji, j2, ■ ■ ■ , ji E {l,2,...,n} we denote by Uj-^,,,,,j- the 
open subset of Flag, „ whose F- valued points are given by the image under $ of the 
set of matrices C = {cki) E FM"^'(F) satisfying 

(1) Cj^i = 1 for all I E {1, ... , i}, 

(2) Cj^i> = for aU Z e {1, . . . , i} and every I' E {I + 1, . . . 

An open subset of this form will be called a standard chart for Flag, „. Considered as 
open subschemes of Flag, „ we identify them with an affine space of an appropriate 
dimension in the usual way. Obviously wc have 



Flag,,„= U 



jl,j2,---,jie{l,2,...,n} 
pairwise distinct 

Hence in order to prove that some subset of Flag, „ is closed we will show that its 
intersection with all standard charts is closed. Furthermore morphisms into and out 
of Flagj „ will be obtained by glueing morphisms into and out of standard charts 
respectively. 



6.3. Subvarieties of Flag . Consider the set 

FM2"'^(F) = \ be FM2"^"(F) 



B' f ^ !" \B = 



^n 

Then $ restricts to a surjection $ : FM^"'^(F) Flag^„(F) 
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We need an economic notation for defining subvarieties of Flag2„. We think that 
such a notation is most easily explained via an example. Consider a table of the 
following form. 



^1 


Z2 


Z3 


/O x\ 
1 

y 

Vo oj 




/o 0\ 

X 

1 
Vo y) 




/O a\ 
/ \ 10 
[gL2{¥)) ^ b 

Vo 0/ 


(x,y)*e(F,)2-{0} 


(a,6)* gF2-{0} 


U.+1 SpecF 


nun 





1 



The upper block defines subvarieties Zi, Z^ and Z3 of Flag4 whose F- valued 
points are given by 

3{x,yy G {¥pf - {0} s.t. B = 



Zi(¥) = $ 



Z2{¥) = $ 



-(F) 



B e FM^''2'-^(F) 



3{x,yY e {¥pf - {0} s.t. B 



/O x\ 


> 




1 






y 




> 


\o 0) 


> 




/O 0\ 






X 






1 




1) 


Vo yj 







and 



Z3{¥) = $ 



B e FM'^''^'-^(F) 



3A e GL2(F) s.t. B = 
3{a, hf e F2 - {0} s.t. B 



\ 



1 
b 

VI Vo 0/ J y 

Furthermore the lower block of the table claims that there are isomorphisms Zi ~ 
Up+i Spec F, Z2 ~ Up+i Spec F and Z3 ~ Pj, ]J Pj, and that dim Zi = 0, dim Z2 = 
and dim Z3 = 1. Note our convention for rows spanning multiple columns where the 
contained information is to be applied to every column separately. The notation is 
not meant to imply any connection between the individual subvarieties. 

Note that this notation is highly ambiguous. For instance we could have written 
Zi ineptly as 



Zi 

/O a\ 
1 a 
b 

Vo 0/ 

(a, 6)* eF2-{0}, ae¥ 
aPb -abP = 
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7. The maps m 

7.1. de Rham cohomology. Let <? > 1. Let f : A ^ S he an abelian scheme of 
relative dimension g. We denote by the de Rham complex of Oj4-modules. 
The first de Rham cohomology sheaf H^j^{A/ S) is defined by 

It is a locally free Os-module of rank 2g, functorial in A, and its formation com- 
mutes with base-change by [U Proposition 2.5.2]. 

Inside Hl)j^{A/ S) we have the Hodge filtration uja, a locally free Os-submodule 
of rank g, given by the image of the injection i?°/*(r2^^^) Hj~,j^{A/S) coming 
from the Hodge-de Rham spectral sequence, cf. [J Proposition 2.5.3]. 

Let A/¥ be an abelian variety. In [13j . Oda constructs a natural isomorphism 
D(A) ^ i7|)^(A/F) taking imV to uja- See in particular |i3, Cor. 5.11]. 

7.2. The map l. We recall a construction from [8l Section 4]. Let / : A""'^ 
Ag be the universal abelian scheme and consider its de Rham cohomology EI = 

Denote by Flag(H) ^ Ag the variety of full flags in H. We define 
a morphism Ai Flag(H) over Ag on ^-valued points as follows: Let {Ai)f^Q € 
Ai{S). We extend it to a chain {Aif^^g by setting A2g^i = A^ for < i < g. The 
map A2g-i A2g-i+i is given by the dual isogeny of Ag^i^i — > ^g-i for < * < 5, 

while the map Ag A^+i is given by the composition Ag ^ A"^ ^g-i = ^s+i- 
Then the image of {Ai)i in Flag(EI)(S') is given by 

= a{HhH{A2g)) C a{H],j,{A2g-i)) C---C a{Hhn{A,)) C H},^{A^), 

where for each a denotes the map induced by Aq — s- Ai. The morphism l is 
universally injective and finite, see [SJ Lemma 4.3]. 

Definition 7.1. Let A E Ag{¥) and consider the final element wa G Wfinai- We 
denote by la the composition 

TT-^A) ^ Flag{Hlj,{A/¥)) ^ Flag(D(A)) ^ Flag^^ 

where the first map is obtained from t by base-change, the second map is induced 
by Oda's isomorphism mentioned above and the third map is induced by the iso- 
morphism ^A from Section HTBl 

Let A E Ag{¥) and w = wa- It follows from classical Dieudonnc theory that the 

F V 

image of la is given by Flag^'2g . Hence la induces a universal homeomorphism 
TT~^{A) Flag^'^^. If we are only interested in topological properties of the 
fiber ■jt^^{A), it is therefore sufficient to study the spaces 

Flagi;25 ■ following 

J- F V 

sections contain a list of the varieties Flag^'jg for g = 2 and 3 = 3. 

8. The varieties Flag;J;'f'^ over the p-rank locus 

Let g ~ 2. Depending on w e l^finii we determine the variety Flag^^;'^'^ C Flag;^ 
by writing down its irreducible components. We use the notation explained in 
Section [Ol 

8.1. w — id. Let J ~ {x E ¥ \ ^ —x}. The irreducible components of Flag[|j'^'^ 
are given by Y, {Zx)xeJ ai^d Zoo with 
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z 




Zoc 






/O a X 






/o ox 








—xa 






a 




(gL2(F)) 




X b 






1 








V J 






^0 b) 








{a,bf e F 


2 _ 


-{0} 




pi 


1 



The are pairwise disjoint and each Zq intersects Z in precisely one point, as C 
runs through JU{(X)}. Hence there arep + 2 irreducible components and Flag[]j'^'^ 
is connected. 

8.2. w = S2- Flagj'^'^'^ is given by 





/O a\ 













b 










(a, 6)* e F2 


-m 




1 



9. The varieties Flag;|;^^^^ over the p-rank locus 

Let (7 = 3. Depending on w e W^gnai we determine the varieties Flag^'^'^ C 
Flag^. We use the notation introduced in Section [^751 For a matrix B E M'^^^(F) 
we denote by Bi the matrix obtained from B by deleting the i-th row, i ~ 1,2,3. 
Furthermore we denote by B»(P|) the blowing-up of in a closed point. 

9.1. w = id. Let / = {{x,yY e (Fps)^ | xP + x + yP+'^ = 0}. The irreducible 
components of Flag[|^'^'^ are given by Y, Z, Too and {Tx^y)(x,yYei'- 



Y 


Z 


(gL3(F)) 




/O detSi \ 

- dct B2 
det B3 
U F3 ) 






B e fm3''2(F), w e f3 
{B v) e GL3(F) 
det det + det +^ + det Bi det = 


Flag3(F) 




3 
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T 


T 




/O o\ 




/o 





o\ 






/o 


a 


o\ 




/O a\ 



























ya 







ya 






a 


V 








a 









xa 





V 


a;a 






1 


1 














b 


-?y 


xP — y /3 






b 1 







1 









yP 


c 


1 




yP 1 






i^O c 0^ 









13) 



















(a, b, cf e - 


F- 


(0,1 


0)* 




(a 


6,c)* 


eF3-F-(0,-y,l)* 






(a,/3)* G 




{0} 










(a 


G F2 - {0} 




B*(Pp) 


B*(Pj) 


2 


2 



In order to get a better understanding of Z we look at the closed subvariety Zq of 
Flag2 3 whose F-valued points are the image under $ of the set {B G FM3^2(F) | 
det det B3 + det + det Bi det B^ = 0}. There is an obvious surjective 
morphism 7 : Z — > Zo and Z becomes a Pj^-bundlc over Zq via 7. It is trivial over 
the intersection of Zq with any of the standard charts of Flag2 3. 

Now Flag2 3 is itself a Pj.-bundle over Grass2,3, the variety of 2-dimensional 
subspaces of F'^, and if we identify Grass2,3 with P| in the usual way, the map d : 
Flag2^3(F) P2(F) of this bundle is given by S{^{B)) = (det Si : detB2 : detSg), 
where B G FM^^^. Choosing homogenous coordinates Xi, X2 and on P^, S 
restricts to a map e : — > V+(XfX3 + Xf'*' + XiX^) making Zq a Pp-bundle 
over the curve V+{X^X3 + X^+^ + XiX^) c P|. 

^ P^bundle^ y+(XfX3 + + X^Xi) 

As it is not immediately obvious from the table above what the intersection 
between the individual irreducible components are, we list them separately. First 
of all the are pairwise disjoint, as ( runs through / U {00}. 



Ynz 


YnT^ 




(/..) 


(. \ ] 




( p ' \ 

I 1 / 


B G FM^*''^(F), -y G F^ 
{B v) G GL3(F) 
det det B3 + det +^ + 
det Bi det = 






Zo 


n 


2 


1 
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Z n Tx^y 


r n z n Too 


Yr\zr\ Tx,y 




/O o\ 






(0 





a\ 





































ya 






{ 











( 








0a 












xa 






1 












xP 


-y 1 






1 






xP 


-y 


a 









1 









yP 


1 






1 






yP 


1 









^0 





1 ) 








/ 






\Q p) 



































(a,/3)*eF2 


-{0} 










n 


SpccF 


1 






Remark 9.1. In [TSl Section 2] Richartz studies a similar situation in order to 
investigate the geometry of the supersingular locus 53. Let us briefly explain how 
her situation is related to ours. Denote by {¥^,F,V, {■,■)) = (F^, Fid, Md, (•, •)^(,f) 
the superspecial Dieudonne module in dimension 3. We look at the variety X of 
flags {W2 C W3 C Wi) in F^ with W^- = W3 and dim = i, F{Wi),V{W^) C Wi 
for all i e {2, 3, 4}. Inside X we have the subvariety X given by those {W2 C W3 C 
Wi) e X{¥) satisfying FiWi), V{Wi) C W2 and imF C M4, compare ^ 2.8]. 

Richartz shows that the image oi X under the canonical projection X Grass2,6 
is isomorphic to the curve C = V+{Xf^^ + Xf^^ + Xf+^) C and that the 
restriction X ^ C has fibers isomorphic to Pj.. Furthermore she shows that the 
restriction of the canonical projection X Grassa^e to X is birational onto its 
image. This image is denoted by Co{N) in loc.cit. It is the key tool used in [T^ to 
describe the structure of S3 . 

To relate these objects to our situation, look at the morphism C : Fl^Sid'e' ~^ 
X given by {W,)Uo ^ iW^)^ for {W,)U e Flagi^'J-^(F). Consider a point 
{Wi)f^2 G X{¥) and the corresponding endomorphisms F^W2 and V\W2 oi W2 in- 
duced by F and V, respectively and write U = ker Fjvi^^ n ker V\W2 ■ Then we see as 
in the proof of Proposition 112.11 below that the fiber of C, over {Wi)j^2 is nonempty 
and isomorphic to P(W). It is isomorphic to Pj. if and only iiU = W2 and consists 
of one point else. The first case occurs if and only if W2 C ker F n kerV, which is 
equivalent to im F C W4 . 

It is easily checked that (^^{X) — Z and that the fibers of the restriction ( : 
Z ^ X oi ( are isomorphic to Pp. Hence we get the following picture: 

Flag|^,f^ 3 Z 

X 2 X CoiN) 

Pi 
C 

9.2. w — S3. The irreducible components of Flagj:'^'^ are given by 
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X 


Y 




/O a\ 



0/3 
a b 
\c d o) 






/O a 0\ 



6 
c 1 

U o) 


V 


/O a\ 


0/3 
10 

[l Oyl 






^) G GL2(F) 


{a, b, c)* e - 


F- (0,0,1)* 


(a,/3)*eF2-{0} 




(a,/3)*eF2- 


{0} 






B*(Pp) 


2 


2 



Hence Flagj:'^'^ consists of two planes intersecting in the exceptional curve of Y. 



9.3. w = S23- The irreducible components of Flag;^^'^^'^ are given by 



X 


Yi 






Z2 




/O a\ 






/o 





o\ 






/O a 








(0 


1 0\ 






(0 





o\ 







































a 

































































a 






0/3 









a 


b 





























1 









a 6 






1 












c 


d 









/? 






1 












\c d 0^ 








c 








V 


V 






V 


Oj 















(: 

(a. 


2) e GL2(F) 
5)* e f2 - {0} 






C 




1 G GL2(F) 






(a,/3)* gF 


2 _ 


{0} 








pi 


2 


1 



We have Fi n y2 = ^'i n Z2 = X n Zi = X n = 0. The curves Yi and ^2 each 
intersect the plane X in precisely one point. The intersections Yi fl Zi and 12 H Z2 
also consist of precisely one point each. 



9.4. w = S323. The irreducible components of Flagj:'^^'^ are given by 



X 


Y 


z 




(0 


1 


o\ 






(0 





a\ 






/o 


a b\ 












a 




















































































p 






















P 









1 












c d 






V 











V 











V 


Oy 








(a. 


py e f2 - 


{0} 






(: 




G GL2(F) 




1 
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We have X O Y = (d while the intersections X D Z and Y D Z consist of precisely 
one point each. 



10. Proof of the results of Sections [H and [H] 



The case w = id for g = 3 is obviously the most complicated one and we use it 
to illustrate the method. Assume that 



C = (C1C2C3) 



/ Cii 

C21 
C31 
C41 

C51 

\C61 

F,V 



C12 
C22 
C32 
C42 
C52 
C62 



Cl3\ 

C23 
C33 
C43 
C53 
C63/ 



is such that {Wi)i — $(C) G Flag;^' ' (F). We evaluate the condition that every 
step of the flag $(C) is stable under Fi^ and Vid, where we use the explicit descrip- 
tion of Fid and Via given in Section 14.61 As we are only interested in the image of 
C under $ we may without loss of generality multiply columns of C by elements of 
F* and add F*-multiples of Cj to Cj for 1 < i < j < 3. We will do so below without 
further mentioning. 

Wi is stable under F and V if and only if 

/ \ 









''31 
^21 



-'-31 



e F ■ 



C21 
C31 
C41 

C51 

\C61J 



This is satisfied if and only if cn = C21 = C31 = 0. 

For W2 the conditions are trivially satisfied if (ci2, C22, C32) = 0. If this vector is 
not zero, we consider several cases. 



(1) cgi 7^ 0: We may assume that (C1C2) is of the form 



/o 


Cl2\ 





C22 





C32 


C41 


C42 


C51 


C52 


\1 


0/ 



W2 is stable under F and V if and only if 
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This is the case if and only if C41, C51 G Fp2 and C32 = ci2C^i, C22 = Ci2C^i. 
Hence we see that we may assume that (C1C2) is of the form 

/O 1\ 

y 

X 

xP b 

yP c 

\l oj 

for some x,y G Vp2 and some b,c E ¥. The fact that C is supposed to be 
an element of FM"'"(F) implies that we have x^ + y^"*"^ + x = 0. 
C61 = 0, C51 ^ 0: We may assume that (C1C2) is of the form 



/o 


Cl2\ 





C22 





C32 


C41 


C42 


1 







C62/ 



The stability of W2 under F implies that 



C32\ 


/C41 


c| J e F . 




C?2/ 





Prom this we get that C12 = and C22 7^ 0, which is impossible as C € 

FM-^(F) implies that C22 + C12C41 = 0. 

C61 = C51 = 0: We may assume that (C1C2) is of the form 

/O Ci2\ 

C22 

C32 

1 
C52 

\0 C62/ 

C e FM-'-(F) implies C12 = 0. W2 is stable under F and V if and only if 

(l)-tf)^^0 

This implies that C22 = and we see that (C1C2) can be chosen of the form 



/o 


o\ 











1 


1 








b 


\0 





for some 6, c € F. 
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For W3 we first assume that (ci2, C22, C32) = 0. We write 

(C4I C42\ 
C51 C52 j . 
C6I C62/ 

If (ci3, C23, C33) = the conditions are trivially satisfied. The flags of this form 
are contained in the set Y. If this vector is not zero, C € FM"'"(F) implies 
(ci3, C23, C33)* e (F • 61 © F • 62)^°"", where -Lean refers to the canonical pairing 
{x,y) x*yon¥^. But (F-&i®F-62)"'"°"" is spanned by the vector (detSi,-detB2,detB3)* 
and hence we may assume that 

(ci3, C23, C33) = (det Bi,- det B2, det B3). 

The stability of W3 under F and V is equivalent to 

dctSf \ / dctSf"' \ 
-detS^ , -dctBf' G¥-h+¥-b2 
detSf / \ deti?f"' J 
This can also be expressed as the vanishing of the determinants of the matrices 

/ det BP \ / det Bf' \ 

Ml = Lb -det bp and M2=Lb -detBf' 

\ detBf / \^ detSf"' / 

But we have det Mi = det Mf and hence we are left with the equation det Mi = 0, 
which is equal to the equation det Bf det B3 + det iJf^ + det Bi det -Bf = 0. Hence 
we sec that the flags of this form are contained in the set Z . 

Finally we have to consider the case where (ci2, 022,032) 7^ 0. We do this accord- 
ingly to the cases introduced in the discussion of W2 above. 



(1) We may assume that C is of the form 



/o 


1 


0\ 





y 


C23 





X 


C33 


xP 


b 


C43 


yP 


c 


C53 







0) 



for some x,y G Fp2 with x^ + + a; = and some 6, c e F. We see that 
the stability of W3 under F and V implies that (C23, C33) = 0. C e FM-^(F) 
then implies that C43 = — 1/C53 and we see that C53 ^ 0. Hence we may 
assume that C is of the form 



/o 


1 


o\ 





y 








X 





xP 


b 


-y 


yP 


c 


1 







0/ 



and we see that flags of this form are contained in the set 
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(3) We may assume that C is of the form 

/O Ci3\ 
C23 

1 

1 
b C53 

\0 C C63/ 

for some 6, c G F. The stabihty of W3 under F and V impUes C13 = C23 = 0. 
C3 _L C2 impUes ces = 0. Hence C is of the form 



/o 





o\ 














1 





1 











b 


1 




c 


0^ 



and flags of this type are contained in the set Toe ■ 

Conversely it is easily checked that the sets Y, Z, and {Tx,y)(x,yyei defined 
above are indeed subsets of Flag"'"'^'^(F). In order to show that they are closed and 
to construct the isomorphisms claimed above one has to calculate their intersection 
with the standard charts. 

For instance we have 



z n c/453 


z n c/456 


/ 621632 - 63l\ 

-632 

1 

1 
621 1 

V631 632 a J 




/ a(62i632 - 631 )\ 
—0632 

a 

1 
621 1 

\631 632 1 / 


621- 631, 632, a £ ¥ 
(621632 - 63i)f + 61+^ + (621632 - 631) = 



These are closed subsets of the respective affine spaces. 

To see that 7 : Z — > is a Pj.-bundle, trivial over the intersections of Zq with the 
standard charts of Flag2 3, we note exemplarily that the prcimage of V45 = Z^ n U45 
under 7 : Z — > is given by {Z n C/453) U (Z n U45Q). It is now easy to define an 
isomorphism 7~^(T45) — > V45 x Pj. fitting into the commutative diagram 




Here V45 is the hypersurface in A| given by the image under $ of the set of matrices 

/I 'o\ 

B e FM^''^(F) of the form S = 621 1 for 621,631,632 e F with (621632 - 

\631 632/ 

63ir + 6f^' + (621632-630 = 0. 
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To prove that Z is irreducible of dimension 3 it suffices to show that V4. {X\X-j, + 
Xf^^ + is irreducible (see Proposition I f 8 .31 belowl . If we consider X\Xi, + 

^ X\X\ as an element of i4r[Xi, X3][X2], we can apply Eisenstein's criterion 
(using the prime element Xx of K{Xx.,X-i\) to see that XfXa + Xf^^ + XxXl is 
irreducible. 

Concerning the intersections only the statement about Z n T^^y is not quite 
obvious, namely that it is contained in the exceptional curve of T^^y Let (a, 6, c)* € 
- F • (0, -y, 1)* and assume that 

/O a 
ya 



yP c 
\l 

First this implies a = 0. If c = the condition on the determinants for elements 
in Z would imply 6 = 0, but (a, b,c) ^ by assumption. Hence c 7^ and we may 
assume c = 1. Then the determinant condition becomes —{x^ — byP) + {—b)P^^ — 
{xP - byP)P = 0. Using + x + yP+^ we get + byP + bP+^ + bPyP^ ^ 0. 

Using y g Fp2 this becomes yP'^^ + byP + 6^+^ + bPy = which is equivalent to 
{y + 6)^+^ =0. As 6 7^ —y by assumption this does not have a solution. 



0\ 




-y 
1 

0/ 



e z. 



11. The CASE OF POSITIVE p-RANK 

In order to investigate the fiber of tt over abelian varieties of positive p-rank 
we need to recall some additional material concerning finite commutative group 
schemes over F and their Dieudonne theory. Our main reference is again [5]. 

Let g > I and A £ Ag{¥). Then A[p] is in a unique way a product of three 
subgroups A[p] = C^'^ x G*'™ x G*'" with G*^'" etale unipotent, G''"* infinitesimal 
multiplicative and G*'" infinitesimal unipotent. One has isomorphisms G*^'" ~ 
(Z/pZ)*^ and G*'™ ~ /i^, where k is equal to the p-rank of A. Here denotes the 
F-group scheme representing the functor S ^ {s £ Os{S) | = 1} on the category 
of F-schemes. In terms of Dieudonne modules this corresponds to a decomposition 
D = © W^^'™ ® VF*'" into subspaces stable under F and V and such that 

• is an isomorphism and V|n/e.u is nilpotent, 

• F^iYi^m is nilpotent and V^yyi.m is an isomorphism, 

• -Fivi/i.u and V\\/\/i,-a are nilpotent. 

Here we write Fn^e,,. for the morphism VF"^'" W'^-^ induced by F etc. We have 
dimp VF'^'" = dimF W^"' = fc and dimp M^*'" = 2{g-k). 

This decomposition is natural: If ^ € .4g(F) with decomposition D(yl[p]) = 
W^'" © VF''™ © Vt^*'" and if a : ^[p] — > is a group homomorphism, the induced 
morphism ©(a) : D(A[p]) D(v4[p]) splits into the direct sum of three morphisms 

Y^e.u _^ T^e.u^ y^Lra _^ x^i,ra ^^^^ ^^^,u _^ y^uu ^ particular 

imD(a) = imD(a) n (M^^'" © W'^"") © imD(a) n W^*'" 

(11.1) 

= im D(a) n VF*^'" © im D(a) n W'™ © im D(a) n M^*'" . 

Lemma 11.1. Let k > and A e A^g'^W) with decomposition D = W'"" © W^^'" © 
14^*'" as above. Let F^f = © C/*'™ © C/'*'" 6e the decomposition induced via 
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Let w — wa and consider the associated data and {'mi)f^-^ introduced in Section 
[7751 Write / = {i e {1, . . . , g} I i = mj and r = {1, . . . , g} - I . 

(1) We have 

lei 

C/"" = 0(F-e,©F.eg+,) 

(2) Lei w S VFfinai,g-fe fee ^^le final element corresponding to the final sequence 
[ip{k + 1) - fc,i/'(fc + 2) - fc, . . . - /c]. Lienoie by (ei)'f^i~''^ the stan- 
dard basis and by (•,•) = (■r)dof pairing introduced in Section \4-(>\ on 
]p2(g-fc)^ Consider the morphism (3 : F^^^^"*^) — > (7i?;en &?/ i-^ e/^+i 
and Cg^k+i £g+k+i for 1 < i < g — k. Then [3 induces an isomorphism 
of quadruples 

(F2(9-fc),Fi;,ys,(~))^(C/^^«,F„|y..„,C/^|t,.,„,(.,.)|t;.,0- 

(3) Let U = [7*^'" J/*'™. Let w G Wgnai.g-fc &e the final element corresponding 
to the final sequence [1, 2, . . . , fc]. Denote by {ei)f^i the standard basis and 

('7') ^ ')dof pairing introduced in Section \4-6\ on F^*^. Consider 
the morphism (3 : F'^'^ — s- U given by Ci 1— > Ci and Ck+i >— > Gg+i for 1 < i < k. 
Then [3 induces an isomorphism of quadruples 

{V^\Fs,Vis,ip))^{U,F^\u,U^\u.{:-)\u)- 

Proof. This is an easy consequence of the expUcit descriptions of and given 
in Section [121 □ 

Corollary 11.2. Let g > 1 and w € Wfinai,g- Then the p-rank on EOw is given by 
w{l) - 1. 

Proof. As above, let ipw and (mi)f^^ be the data associated with w. We see from 
Lemma 111.11 that the p-rank on EOw is given by #{i € {1, . . . ,g} \ i — mi} — 
i^{i G {1, . ■ . ,g} I tkw{i) — *}• It follows from Section |4?T] that for all i G {1, ■ • • ,5} 
we have ipw(i) — i ^ (Va G {1, . . . , 5} w{a) > i). As w is final, this is equivalent to 
w{l) > i and there are u;(l) — 1 elements of {1, . . . , <?} satisfying this inequality. □ 

Remark 11.3. In this way we have obtained a formula for the p-rank on an EO 
stratum which is considerably simpler than the one cited in Proposition [?210- 
Given both formulas it is of course easy to show by combinatorial means that they 
are equivalent. 

Proposition 11.4. Let K be an algebraically closed field and V a vector space of 
finite dimension g over K . Let Vi and V2 be subspaces ofV with V = Vi V2 and 
dimif Vi — fc, dimif V2 = g — fc. Fix integers < i < max(0, i + k — g)<l< 
min(j, fc) and a subset J (Z {1, . . . ,i} —: I of cardinality I. 
(1) Consider the set 

..... ^ C F.a.,.(V) I V. C Z ;^^^^,) } , 
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where Flagjg(V) denotes the (classical) variety of flags {^jYj^Q in V with 
dim^j = j for < j < i. Then Zg^i^k,.j is a closed subvariety o/Flagj ^(V). 

Consider the maps Lp : {0, 1, . . . , i} ^ {0, 1, . . . , ^} and (p' : {0, 1, . . . , i} ^ 
{0, 1, . . . , 5 - /} with (p(0) = = (y5'(0), 



and 



fU - 1) + 1, J e J 



^'(i-i), jeJ 

Then the map a,j : Flag; ,,.(Vi) x Flag^_, g_j.(V2) Zg^i^kj given by 



is an isomorphism of (classical) varieties. 
(2) Consider the set 

dimK(J^j n Vi) = / A 

(Vj el Tj= n Vi e n V2) 

Then Zgj^k,i is a closed subvariety o/ Flag, „(V) and 



^g,:,k,l - \ (^)}=o e Flag,^g(V) 



Zg,^,k,l = U ^9.^,kJ ^ II Fla&,,(Vi) X Flag,_,,g„fc(V2). 

(3) Consider the set 

Zg^^,k = {(^,)j=o e Fiag,^3(v) I Vj e / = n Vi e n V2} . 

T/ien Zg_i^k is a closed subvariety o/Flag^^(V) and 

111111(2, /c) 111111(2, fc) 

Zg,^,k^ U Zg,,,k,i^ n U Flag;^,(Vi) X Flag,_;,^_,(V2). 



Consider integers Q < i < n. The Frobenius o" : F ^ F induces an automorphism 
E : Flagi „(F) -> Flag, „(F). It is given as follows: Denote by p : F" -> F" 
the componentwise application of a. Then for [TjYj^Q S Flag, „(F) we have 
= {p{Tj))]^„. We denote by Flagi„(Fp) the fixed point set of S. 
It is a finite subset of Flagj „ (F) and it can be identified canonically with the set of 
flags in (Fp)" with dim = j for aU Q<i<i. 

Proposition 11.5. Let g > 1, k > and A g aI''\¥) with w — wa- 

(1) Assume that k = g (i.e. A is ordinary). Then the fiber of t: over A is 
discrete and 

# {n-\A)) = ONg := 2^#Flag^(Fp) = 2^11^?'^ = ^'^T^^fe^' 

l=Q i=0 ' 

(2) Assume that 1 < k < g — 1. Then Flag^'^'^ is isomorphic to ^'^^ ONk 

disjoint copies o/ Flag~'^^'^j,-j, where w is as in point ^ of Lemma \ll.l\ 
Note that the p-rank on EOq, is equal to 0. 
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Proof. We use the notation of Lemma 111.11 



(1) Uk = gwe have = 0, = ©f^^F • a and C/'^" = ®tig+i^ ' ^i- Let 
w — WA- We use the notation of Proposition 1 1 1 .41 for V = F^^, Vi = U'^-" 
and V2 = C/*'™. By Equation lll.il we see that 

a 

F^i^sijg"^ C Z2g,g,g = II II a J (Flag,,,(Vi) x Flag,_,,g(V2)) ■ 

/=0 JC/ 

Let < I < g and J C / of cardinahty L 

First note that i^|Vi is equal to the componentwise apphcation of u (with 
respect to the basis (ei, . . . ,eg)) and that ViVi = 0. On the other hand 
V|V2 is equal to the componentwise application of (with respect to the 
basis (eg+i, . . . , 62^)) and F^-^^ = 0. From this it follows immediately that 
Flag^'^ n a, (Fla&_^(Vi) x Flagg_,,^(V2)) ~ Flag;^g(Fp) x Flagg_;^g(Fp). 

Let ((^,)^=o>(5.7)';o) e Flag;^3(Vi) x Flagg_,,<,(V2). Then the image 
a,7 (^{^jYj^o, (^j)j=o) symplectic if and only if (^)^Zo actually a flag 
in the g — I dimensional space V2 H J^i^ , where we consider J-i as a subspace 
of V. 

Combining these two statements it follows that 
Flagi^^'^ n aj {FlagijVi) x Flag<,_,,g(V2)) ^ Flag.JWp) x Flagg_;(Fp). 

The claim now follows from a short calculation. 

(2) We use the notation of Proposition fTOl with V = F^f, Vi U"-^ © t/*'™ 
and V2 = /7''". It follows from Vi = and Equation II 1 .11 that 

Flagi^^^^ C Z2<,,3,2fc,fc = II a/(Flag,^2fc(Vi) xFlag3_,^2(^_,,)(V2) 

JC/ 

Let J C / of cardinality k. Using the notation and the isomorphisms /3 and 
(3 of Lemma 111.11 we see that 



Flagi'^^^ n aj (Flag,^2,(Vi) x Flagg_,^2(^_,) (V2)) ^ Flag^ ^^.^ x Flag 



±,F.y 

w ,2{g — k) ' 



J- F \^ 

By the first point Flagjj'2^ is discrete of cardinality ONk and the claim 
follows. 

□ 



12. The number of connected components of the fibers of tt 
Proposition 12.1. Let g > 1- For all A e W'g^\¥), the fiber Tr~'^{A) is connected. 

Remark 12.2. In [T71 Proposition 5.2] Yu proves a more general statement. We 
rephrase his proof in our language. 



Proof of Provosition \12A\ Let w ~ wa- We have to show that Flag^'^'^ is con- 
nected. Let < i < I = \ 
F- valued points are given by 



nected. Let Q < i < g, / = {0, . . . , i} and denote by Flag^'f'^ the variety whose 



Flag^'^-^fF) - liW Y e Flag (F) I ^-^^ ^ ^ V^{W,lF^{W,) C W, 
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Then Flag^'^'^ — Flag^'^'^ and we will show by induction on i that Flag^ 



is connected for all < i < g. For each I < i < g consider the morphism 
C. : Flagi;f'^ ^ Flag;:;;flY given by C. ((W^,)}=o) = (W^.)}=o ior (W,))^, G 
Flag^'f'^(F). This is, in particular, a closed map of topological spaces and it 
will be sufficient to show that it is surjective with connected fibers. Fix a point 
(WjYjZl e Flag;^',^Y(F) and write W = W^_^lWi-x with canonical projection 
: W^-^ W. Fu, and induce endomorphisms F and V of W. Our assump- 
tion on the p-rank of A implies that F and Y are nilpotent. This means that a 
1-dimensional subspace of W is stable under F or 1/ if and only if it is contained 
in kerF or kerV, respectively. Therefore consider the subspace U — kerF n kerl^ 
and denote by VijX) the (classical) projective space over U. Consider the map 
P(ZY) Flagj 2£,(1F), sending a subspace U CU to the flag 

WoCWiC---C W,-i C pr-\U). 

With the conciderations above this map is easily seen to induce an isomorphism of 
(classical) varieties P{U) (^f^ {{WjYjZJo) C^)- Hence the fibers of are connected. 
To see that they are nonempty we have to check that dimU > 1. This is automatic if 
F and V are the zero morphism. By Proposition 13 . It fT]) we know that imV C ker F 
and imF C keiV. Now the nilpotency of F implies that imF n kerF ^ if 
F and the nilpotency of V implies that im y fl ker V ^ if V 0, whence the 
claim. □ 



Proposition 12.3. Let g > 1 and k > 0. If A e A'-J'^W), the fiber tt-^ (A) consists 
k = 0. 



of 



ONk connected components. In particular it is connected if and only if 



Proof. Combine Proposition 111.51 and Proposition ll2.1l 

13. Dimension of the fibers of tt 



□ 



Let 5 = 2 or 5 = 3 and let A £ Ag{¥). Depending on wa & Wfinai we list the 
dimension of Tr^^{A) C Aj. It can be read off the calculations in Sections [8] and [9] 
and the results of Section [TT] 



5 = 2 


5 = 3 


Wfinal 


dim 




dim 


Wfinal 


dim 


id 


1 


id 


3 


S123 


1 


S2 


1 


S3 


2 


S3I23 


1 


Sl2 





S23 


2 


S23123 





S212 





S323 


1 


S323I23 






14. The KR stratification 



This section contains the results about the KR stratification on Ai that we are 
going to use. We will use an ad hoc definition on F-valued points and we refer to 
[71 Section 2.4] for a more comprehensive treatment of the subject. 



14.1. Relative positions. 



\2g 



e Flagi;2^,^(F). 



Proposition 14.1. [H Section 3] Let g > I, w e VFfinai and (Wi^j^Q c ^ '^'^&w,2g 
There is a unique element x = t^u) G WaT (uj £ W, X £ X^,{T) ) such that there is 
a basis (ei)^£o o/F^^ with the following properties: 
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(1) e {0,1} for all i. 

(2) For every i, Wi is spanned by ei, . . . , Ei. 

(3) // V^{W^-i) C V^{W^) for any i > 1, we have V^{W,) = K,(W^.-i) © F • 
(4) 

i=l,....2g 
A(i)=0 



We call any such basis a KR basis for {Wi)^^Q and x is called the KR type of 

The set of possible KR types (as w runs through Wfinai) is denoted by Adni(/Li). 
It is a subset of WaT. Given w £ Wflnai and x e Adm(^) we denote by C{x, w) the 
set of flags in Flag^' ' (F) with KR type equal to x. 



14.2. The KR stratification. On Aj we have the Kottwitz-Rapoport stratifica- 
tion (a stratification in the sense of Section 12. 2p 

given by {Ai)i e ^7,x(F) if and only if tAo((^i)i) € C{x,wao)- 

The following Proposition lists some properties of the KR stratification. 



Proposition 14.2. 5^, Section 2.5] Let x,y e Adm(^) and uj e W, A e X^{T) 
such that X — t^uj. 



(1) Ai^x is equi- dimensional of dimension i(x) . 

(2) The p-rank is constant on Ai^x with value #Fix(w)/2 (where Fix(w) = {i G 
{l,...,2g}\uj{€)^i}). 

(3) We have Ai,x C Ai^y if and only if x < y. 

(4) If Ai^x is not contained in the supersingular locus Sj, then Ai^x is irre- 
ducible. 



In view of property ^ we denote by Adm(/i)^') the set of admissible elements 
of p-rank i, < i < 5. 

Lemma 14.3. [HI Lemma 8.1] The projection W ^ W induces a bijection ^ : 
Adm[fj,Y^') {m £ W \ Fix(cij) = 0}. Its inverse is given by uj ^ t^^^^Lo with 

A(a.)W = | ^ , z = l,...,2g. 



14.3. The set Adm(/i)("). In 16] Yu gives a list of aU the 29 elements of Adm(/x)(°) 
for (7 = 3. We copy this list as we will use it extensively. 
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KR 


(A, w) £ A*(J ) X W 


KR 


(A, w) £ X^\l) ^ W 


T 


(0,0,0,1,1,1), (14j(z5)(dD) 


S310T 


/A A 1 A 1 1\ /'"100/^/ir\ 

(0,0,1,0,1,1), (132545) 


SqT 


(0,0,0,1,1,1), (1463)(25) 


S120T 


(0,0,0,1,1,1), (1d)(2453) 


SlT 


/A A A 1 1 1^ /1 /1A^'Oc^^ 

(0,0,0,1,1,1), (142635) 


S320T 


(0,0,1,0,1,1), (154623) 


S2T 


/A A A 1 1 1^ /1c^o^'A/1^ 

(0,0,0,1,1,1), (153d24) 


S230T 


/A 1 A 1 A "l\ /"I0/1/^C:0\ 

(0,1,0,1,0,1), (124653) 


S3T 


(0,0,1,0,1,1), (13o4)(z5) 


S201T 


(0,0,0,1,1,1), (1562)(34j 


SlOT 


(0,0,0,1,1,1), (145)(/d3) 


S301T 


/A A 1 A 1 "l\ /'"I0C/^/1O\ 

(0,0,1,0,1,1), (135642) 


520^ 


(0, 0, 0, i, i, i), (i0oj(z4D) 


S121T 


(U, 0, 0, i, i, i), (i6)(2oj(34j 


S30T 


(0,0,1,0,1,1), (13)(25)(46) 


S231T 


(0,1,0,1,0,1), (1265)(34) 


SOIT 


(0,0,0,1,1,1), (142)(356) 


S312T 


(0,0,1,0,1,1), (16)(2354) 


S21T 


(0,0,0,1,1,1), (15)(26)(34) 


S323T 


(0,1,1,0,0,1), (123654) 


S31T 


(0,0,1,0,1,1), (135)(264) 


S3010T 


(0,0,1,0,1,1), (132)(456) 


S12T 


(0,0,0,1,1,1), (16)(24)(35) 


S3120T 


(0,0,1,0,1,1), (16)(23)(45) 


S32T 


(0,0,1,0,1,1), (154)(236) 


S3230''' 


(0,1,1,0,0,1), (123)(465) 


S23T 


(0,1,0,1,0,1), (124)(365) 


S2301''' 


(0,1,0,1,0,1), (12)(34)(56) 


SOIOT 


(0,0,0,1,1,1), (145632) 







15. KR STRATA AND THE FIBERS OF TT 

Let .9 > 1 and x E Adm(/i). We write 

ES(a;) ^{wE W^fi„ai | Tr~\EO.^) n A/,, ^ 0}. 
Then [S[ Corollary 3.3] states that 
(15.1) n{Ai^,)= U 

uieES(a;) 

Hence in order to understand the relationship between the EO and the KR strati- 
fication we need to understand the sets ES(a;). 

Now for all w € Wgnai we have w € ES(x) <^ £{x, w) ^ ^ and it is therefore 
sufficient to study the sets C[x, w). We will do this for 5 = 3, using our calculations 
of the sets Ylaglj'^'"^ . The sets £(a;,id) are rather complicated and we content 
ourselves with determining whether they are nonempty. For the other final elements 
w of p-rank we are able to determine the sets >C(x, w) completely. 

First we have the following general result: 

Lemma 15.1. Let g > 1. 

(1) For u} e Sg ^ {si, . . . ,Sg^i) C W we have UJT £ Adm{fi)'-"'' and ES{ljt) = 
id. 

(2) For X ^ t^Lu £ Adm(/x)(") (X £ X^(T), lu £ W) we write = {i £ 
{1,...,25} I uj^{i) < u){i) < i}. Then for {Ai).i £ Ai^x(^) we have g- 
a{Ao) > #iV.. 

Proof. (1) Let uj £ Sg, then ujt is admissible by Lemma 114.31 above. Consider 
{Ai)i £ Ai^uiri^) with image {Wi)i under laq- satisfies ^(u;t)({5 + 
1, . . . , 2g}) = {1, . . . , g}, which means that im V^a^ = ker 14)^0 — ^g- By 
Proposition 13 . 1111 1 this implies that imi^^^ = keri^,^^, hence the canonical 
filtration on ID)(Ao) is given by C F{D) C D which has associated final 
element id. 
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(2) By Lemma 132] and Proposition 14.31 om claim is equivalent to the following 
statement: Let w e W^°^^-^ and (Wi)-fo G Flag;i;'f^^(F) of KR type x. Then 
dimimVj > #7V^. 

But if (e)i£o is a KR basis for {Wi)i, the set {V{e^(i)) \ i € N^} is a 
Hnearly independent subset of imFj of cardinality ^N^- 

□ 

For the rest of this Section g is equal to 3. 

15.1. w — id. Let x G Adm(/i)'^°) . By Lemma ri5.1l( 2]) we know that C{x, id) ^ im- 
plies that Nx = 0. Inspecting the table in Section ri4.3l we see that this condition is 
only satisfied for x G {r, sir, S2T, S2it, si2r, si2it, ssqt, ssiot, S320T, S3i20'r, S2301T}. 
We claim that id G ES(a;) for all x in this set. For x G S3T = {r, sit, S2T, S2ir, Si2r, 
S121'''} this is true by Lemma |15.HfT|l . For the remaining elements we write down 
an explicit nonempty subset IC{x) C C{x,id). 







A;(s230it) 




/O l\ 






/O 1\ 






/O 1 0\ 





































































1 






1 






1 






V 0) 






\o 1 0) 






\i 0) 





^(s3iot) 


^(s32ot) 






/ -1 \ 






/ -1 \ 








62 






62 








6^+' + bi 






bf'b2 + bi 








bi 62 a 






bi 62 c( 








-&2 1 






-bf' 1 








V 1 ) 






I 1 ) 








62 G F-Fp2, a G F 




62 G F-Fp2, a G F 






61 G F a root of 




5i G F a root of 




TP + T + 6^*^+^^ G F[T] 


TP" +TP + bP+^ GF[r] 




2 





15.2. w — S3. We list those C{x, S3) which are nonempty. 



'C(S120T, S3) 


'C(S3120T, S3) 


'C(s3i2r, S3) 




/O o\ 




/O a\ 






/O 1\ 












































1 




1 













1 




1 






1 










V 1 V 






[c 1 0) 




c G F 


c 


G F, a G F 


X 


c G F 


1 


2 


1 
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'C(S201T, S3) 


'C(s23oir, S3) 


'C(S231T, S3) 




/O o\ 




/O a 0\ 




/O 1 0\ 








































1 




1 











c 1 




c 1 




c 1 






V 0) 




V 0) 




VI 0) 




ceF 


ceF, aeF^ 


ceF 


1 


2 


1 



'C(S30T, S3) 


C{sqT, S3) 




'C(s3r, 


53) 






/O a\ 






/O 0\ 






/O 


1\ 






















































1 






1 
















1 






1 






1 















[1 0) 






[1 


0) 










1 









.3. w = S23- We list those jC{x, S23) which are nonempty. 



'C(S20T, 


S23 


) 


'C(s32or, S23) 


C{si20T, S23) 


'C(s3i2or, S23) 


'C(S312T, S23) 




/O 


0\ 






/O a\ 






/O o\ 






/O Q:\ 






/O l\ 





















































































1 






1 






1 






1 













1 









1 






1 






1 






1 






[0 1 








[0 1 0) 


















[c 1 0) 






aeF>^ 


ceFx 


c,a eF^ 


ceF^ 





1 


1 


2 


1 



'C(S32T, 


S23 


) 


'C(s3ioT, S23) 


jC-{swT, S23) 


>C(S31T, S23) 


C{saiT, S23) 




/O 


A 






/O a\ 




/o 





o\ 


/o 


1\ 


/O o\ 


























































































1 










1 








1 






1 









1 







1 








1 


1 






[0 1 


V 






[1 0) 




V 





0/ 


V 


0/ 


VO lyi 

















1 
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'C(S201T, S23) 




S23) 


'C(s23ir, S23) 


^S3230T, S23) 


'C(S3010T, S23) 




/O o\ 




/o 


1 


o\ 




/O 1 0\ 






/O 1 0\ 






/O 0\ 





























1 











































1 






1 





























1 






1 










1 




c 1 






0/3 






1 






\0 c l) 




V 





0; 










V Oyl 






[0 /3yl 








c e 




/3eF 


1 





1 


1 


1 



15.4. w = 5323- We list those C{x, S323) which are nonempty. 



'C(S3230T, S323) 


'C(S323T, S323) 


^S23QT, S323) 


^saowT, S323) 




/O 1 0\ 






/O 1 0\ 






/O 1 0\ 






/O a\ 






1 






1 





































































1 






0/3 













1 






1 






V 0) 












\i 0) 






V 0) 




/3 e F^ 






a e F^ 


1 








1 



£(S010T, S323) 


'C(S301T, S323) 


^S23QlT, S323) 






/O o\ 






/O 1\ 






/O a l\ 






















































1 






















1 






1 






1 








\i 0) 






\i 0) 






[1 0) 










a e F^ 










1 





16. Proof of the results of Section [T5] 

In order to illustrate the method we show that /C(s3ior) C £(s3iot, id). 
V = Vid- For an element (W^i)f^g of /C(s3iot)(F) choose elements 62 G F - 
a e F and 61 e F with b{ + h + 



(*) 



6 

1=0 



''2 


+1) ^ 


such that 






/ 





-1 


\ 










62 




$ 










bi 


bi 


b2 


a 






-bl 


1 









\ 1 








) 



Let 

F.2, 
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First we write down a matrix C — (C1C2C3C4C5C6) G GL6(F) such that Wi = 0j^iF- 
Cj for aU < i < 6. For the first three columns of C we can use the columns of the 
matrix of Equation (*) above. We find the other columns using the condition that 
O^i)i=o ^ symplectic flag, meaning that C4 _L ci, C2 and C5 _L ci. Hence 



/ 





-f 








0\ 








b2 





f 











hl+^ + 61 





hi 


1 


61 


b2 


a 


f 










1 














\ 1 














0^ 



satisfies our requirements. 

From this matrix we can read off the images (I^(Wi))f^o using the explicit 
description of Section 14.61 and we need to find a basis (£1)^=1 of such that 
Wi = ®j^iF • Ej and such that ^(Wi) is spanned by a subset of {ei, . . . ,6^} for 
each < i < 6. First we have V{W2) = 0. Now ^2 i Fp2 imphes that V{W'i) ^ Wi 
and hence we can take £2 = V{c^). The equation for hi implies that ^(Ws) C W2 
which means that we can use ei = ci and £4 = 04. 

This means that a KR basis (ei)i=i of iWi) is given by the columns of the 
following matrix 



/ 








-f 








o\ 










b2 





f 













bP+' + 5i 





bl 


1 




61 


— 2 


a 


1 


























V 


1 


1 











V 



Here the equation for hi is needed to see that ¥{63) — £2. We have observed that 
ViWi) = V{W2) - 0, V^(W3) = V{Wi) = (£2), V{W^) = (£i,£2) and V{We) = 
(£i,£2,£4). Hence if A e X^{T) and uj £ W are such that {Wi)i € C{t^uj, id), we 
see that A = (0, 0, 1, 0, f , 1) and that uj{3) ^ 2, w(5) = 1 and w(6) = 4. The ueW 
satisfying these conditions is given by 

/I 2 3 4 5 6A 
^ 1^3 6 2 5 1 4/ 

and from the table in Section ff 4. 31 we see that = S310T. 

The proof of /C(s32ot) C £(3320''", id) is similar and in all the other cases it is 
very easy to write down a suitable KR basis. 



17. The sets ES(x) for x e Adm(/^)(°) in dimensions 2 and 3 

Let g = 2. In this case the sets ES(a::) for x € Adm(^)'^*'^ have already been 
known, see for instance [SJ Example 3.4]. They are given by 



X 


ES(a;) 


T, SlT 


id 


S2T, SqT 


S2 


S20T 


id S2 
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Let g — 3. The following table contains the sets ES(a;) for x g Adm(/j,)*^°). 
They can be read off the calculations in Section [TS] The upper block contains the 
supersingular elements. 



X 


ES(a;) 


T, SlT, S2T, S21T, S12T, S121T 


id 


SsT, SqT 


S3 


S30T 


id S3 


SlOT, S23T, S20T, S31T, SoiT, S32T 


S23 


S310''', S320''' 


id S23 


S3I20T 


id S3 S23 


Sl20'r, S3I2T, S2OIT, S231T 


S3 S23 


SQIO''', S323''', S3OI''', 5230^ 


S323 


S2301''' 


id S3 S323 


S3OIO''', S3230''' 


S23 S323 



Remark 17.1. We can use this table to answer a question posed in a preliminary 
version of |7j : For every 5 > 1 one has the following inclusion: 



(17.1) 



\ 



\EO^,lZSg 



J 



In loc.cit. it was asked whether this inclusion is an equality. The answer is negative 
in the case 5 = 3: Let A E i?Oid(F). By the table above there is preimage {Ai)i € 
{■K~^ (A) (1 Ai^s3iot){^) of A, so that {Ai)i is contained in the right hand side of the 
above inclusion, but as Ai^saw-r ^ i^ i^ contained in the left hand side. 

17.1. Some informal observations. Let 1 < g < 3. It is interesting to note that 
ES = ES(x) for every a; € Adm(/i)(°). We don't know if this is true 

for arbitrary g. 
Compare the line 



X 


ES(a;) 


S2T, SqT 


S2 



of the table for g = 2 with the lines 



X 


ES(a;) 


S3T, SqT 


S3 


SIOT, S23T, S20T, S31T, SoiT, S32r 


S23 



of the table for g = 3. 

We can prove the following result, generalizing these lines: Let 2 < g, i E {0, 1} 
and consider the sets Sj = {sj, Sg_j} C W for < j < «. Then for every element 
X E Adm(/i)("^ of the form (f„(o) 



tv{i) ' ' ' tv{i)) where v E S'({0, . . . , i}) and 



tj E Sj for aU < j < i, we have ES(a:;) = {s 



^g-i+l ■ ■ ■ Sg 



}■ 



18. The KR stratification and the supersingular locus 
Let g — 3. For x E Adm(/i)'^°) we want to understand the intersection Ai.x H Sj. 
Proposition 18.1. Let g = 3 and x E Adm(/i)(°) . Then Ai^^f^Si = ^ ES(.t) = 

{S23}- 



MODULI SPACES OF ABELIAN VARIETIES OF DIMENSION 3 



35 



Proof. This follows from the results of Section [5l using Equation 115.11 □ 

Remark 18.2. The relationship between the KR stratification and the supersin- 
gular locus is closely related to the theory of afhne Deligne-Lusztig varieties. In 
pn Proposition 12.6], Haines shows that for x e Adin(/i)(°) the nonemptiness 
of the intersection Ai^x H Sj is equivalent to the nonemptiness of a certain afHne 
Deligne-Lusztig variety. In loc.cit. this result is stated using p-adic Deligne-Lusztig 
varieties, but by ^ Corollary 11.3.5] the non-emptiness of an affine Deligne-Lusztig 
variety is equivalent in the function field and the p-adic case. 

We want to get a more precise statement about the intersection Ai^xt^Sj in those 
cases where it is nonempty and not equal to Ai.x- For this we need the following 

Proposition 18.3. Let f : X Y be a proper morphism of algebraic varieties 
over an algebraically closed field K . Let B d Y be a locally closed subset equi- 
dimensional of dimension d € N. Let A d X be a locally closed subset with the 
property that there is a natural number e G N such that f~^{b) (1 A is irreducible of 
dimension e and dense in f^^{b) O A for every b G B{K), where we denote by A 
the closure of A in X . Then f^^{B) C] A is equi- dimensional of dimension d + e. 
Furthermore the number of irreducible components of f^^{B) H A is equal to the 
number of irreducible components of B. 

Proof. We immediately reduce to the case B — Y and A — X. We may also assume 
Y to be irreducible. Hence we are reduced to the statement of the following Lemma 
whose proof we include for lack of reference. □ 

Lemma 18.4. Let f : X ^ Y be proper morphism of algebraic varieties over an 
algebraically closed field K . Assume that Y is irreducible of dimension d G N and 
that the fiber f^^{y) is irreducible of dimension e G N for every y G Y{K). Then 
X is irreducible of dimension d -\- e. 

Proof. Let X = Ci U C2 with closed subsets Ci, C2 C X. Let /i and /2 denote the 
restrictions of / to Ci and C2 respectively. By a Corollary to Chevalley's Theorem, 
see [HI 13.1.5], the sets Fi = {y & Y \ dim/~^(y) > e} are closed subsets of F, 
i = 1,2. For y G Y{K) the e-diniensional fiber f~^{y) is the union of the closed 
subsets fi^{y) and f2^{y) and hence j/ G Fi U F2. As the set Y{K) is dense in Y 
this implies that Y = Fi\J F2 and by the irreducibility of Y we may assume that 
Fi = Y . Let X G X{K) be a closed point with image y = f{x) G Y{K). Then 
dim/f ^(y) = dim/^^(y) n Ci = e and as f^^{y) n Ci is a closed subset of f^^{y) 
and the latter is irreducible of dimension e, we get f~^{y) flCi = f~^{y) and hence 
Ci D f~^{y) 9 X. This implies that Ci — X and we see that X is irreducible. 
Furthermore the closed subset {y ^ Y \ dim/^^(y) > e + 1} oiY does not contain 
a point of Y{K), hence it is empty. This means that dim/^^(y) — e for all y E Y. 
We can now apply [51 10.6.1(iii)] to get the result. □ 

We are now ready to determine the dimension of the intersection Ai_x H Sj for 
those X G Adm(/i)^°) with Ai.x ^5/. It is clear a priori that for any such x we 
have dim Ai^x H 5/ < dmiAi^x — 1 = ((x) — 1 as this intersection is a proper closed 
subset of the irreducible space Ai^x, see Proposition 114. 2P )). The following table 
shows that this inequality is in fact an equality for g = 3. 
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X 


n Si 


equi-dimensional? 


SSIOT, S320''' 


2 


? 


531207" 


3 


7 


S2301''' 


3 


7 


S120T, S312T, S201T, S231T 


2 




SQIO''', 5323^, SSOlT", 5230^ 


2 




S3OIOT, 53230^ 


3 





18.1. Proof. For x G {si2ot, S312''', S20i''': S231'''} we apply Proposition 118.31 for tt 
with B = EOs^ and A — Ai^x- It is clear from the results of Section fl 5. 21 that the 
conditions on the fibers (appearing in Proposition 118. 3p are indeed satisfied. For 
example we have 



•^I .Si2()T ,Sl20T U Aj^Si2T U Aj_S2()T U Aj_Si()T U Aj_SiT U Aj ^S2T U Aj ^SqT U Aj ^ 

hence we see from Section [15.21 that for b E EOssi^) we have 



AI,s^2orr\^T \b)^AI,s^20Tr\^T \b) U Al ,,„r n TT \b). 

By the results of Section 115.21 we see that 



/O 0\ 





1 

1 

V 1 0/ 



Lbin ^{b)r]Ai^si20T) 



fo o\ 





1 

1 



/O o\ 





1 

1 



ce F 



Hence '!t~^ (b) Aj ^si2ot is irreducible of dimension 1 and dense in TT~^{b) nAi^si20T- 
As TT~^{EOs3)r\Ai^x = SiHAi^x by the results of Section[n]and the table in Section 
[T71 our claim follows. 

For X e {sqiqt, S323T, S301T, S230T, S3010T, S3230'r} we apply Proposition[18J| for tt 
with 5 = 53n£'Os323 and A = Ai^x- It follows from Section [15.4l that the conditions 
on the fibers are indeed satisfied and we have tt~^{EOs323 ^ ^3) ^ ■^i,^ =5/0 Aj^x 
by the results of Section O and the table in Section [T71 

Furthermore we have ^^^{EOs^) H Ai^s3i2or C Sj -47.53^201- and 7r"^(£^Os323 ^ 
S3) n Ai^s2aoir C Si n Ai^s23oiT and we use Proposition 118.31 and the results of 
Section ri5. 21 and 115.41 respectively, to see that these subsets have dimension 3. 

Finally let A e EOid(^). Then n''^{A) n Ai^^sior C Si n -4/,s3iot and n~^{A) n 
'^I,S320T C 5/ n Ai^s32oT- But thcsc subscts have dimension at least 2 because 
dim/C(s3ioT) = dim/C(s32oT) = 2 (see Section [T5TT]). 

Remark 18.5. If g is even it is shown in [8] Proposition 8.12] that every top- 
dimensional irreducible component of Si is an irreducible component of the left 
hand side of Equation (TTTTJ Looking at the table above we see that the correspond- 
ing statement is not true for g 3, as dimS*/ = 3 in this case. 

Remark 18.6. It is strongly expected that the relationship mentioned in Remark 
118.21 extends to other properties of the intersection Ai,x H Si, x £ Adm(/i)^°^ In 
particular strong evidence suggests that Ai^x H Si is equi-dimensional of dimension 
n if and only if the corresponding afhne Deligne-Lusztig variety (in the function field 
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case) is equi-dimensional of dimension n, n € N. In [5], Goertz and He explain a re- 
duction method for affine Deligne-Lusztig varieties over function fields which is com- 
pletely analogous to the classical reduction method by Deligne and Lusztig. Using 
this reduction method one sees that the affine Deligne-Lusztig varieties correspond- 
ing to the intersections Ai^x H Si for g = 3 and x g {ssiot, S320T, S3120T, S2301'''} 
are equi-dimensional. Hence we expect that the same is true for the intersections 
themselves. 
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